CI: add mpi/distributed module to free CI pipe - #814
Open
iarejula-bsc wants to merge 4 commits into
Open
Conversation
Author
|
added author info in the header per convention, not sure if this is correct, might be better placed in the headers of the new test instead. Happy to change if needed. |
iarejula-bsc
force-pushed
the
minidmr_ci
branch
from
August 3, 2026 13:51
06475eb to
9d7618d
Compare
Credits: AccelCom @ Barcelona Supercomputing Center
Credits: AccelCom @ Barcelona Supercomputing Center
Credits: AccelCom @ Barcelona Supercomputing Center
Credits: AccelCom @ Barcelona Supercomputing Center
Author
|
i run the tests on mare nostrum 5 and on minidmr local and gh actions, same results on all of them |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds three free CI jobs, all using minidmr, an open-source tool built by our team that allows creating a reproducible HPC cluster on Docker to simulate a multi-node MPI cluster . minidmr is already integrated into the CI pipelines of two of our other projects, and is also used to run MPI tests locally.
By using it on QuEST, this lets your CI pipeline run MPI tests on a single free
ubuntu-latestrunner.test_paid.ymlis untouched for now; however, after a careful review, it could be removed in a follow-up to save money.This PR adds:
test_free.yml: distributed-minidmr-test: full functional tests over real MPI (minidmr, 4 simulated nodes).audit.yml: sanitisation-test-mpi: ASan overcomm/*(the MPI code), minidmr with 2 nodes : the first time this code has run under a sanitiser.audit.yml: coverage-test-mpi: lcov overcomm/*via minidmr, 2 nodes: complements the existing serial coverage job, which can't exercise MPI.Impact:
mpi=ON, cuda=OFFintest_paid.yml, ~$4.80/run, only triggerable manually viaworkflow_dispatch) with free jobs on every push/PR, saving ~$5/run.comm/*goes from 0% measured (explicitly excluded from the serial coverage job, which doesn't compile with MPI) tocomm/comm_config.cppat 77.4% andcomm/comm_routines.cppat 4.3% line coverage.